Papers with latent representation
Counterfactuals to Control Latent Disentangled Text Representations for Style Transfer (2021.acl-short)
Copied to clipboard
| Challenge: | Existing methods for unsupervised text style transfer focus on transferring a specific attribute, but this technique has never been explored in natural language generation tasks. |
| Approach: | They propose a counterfactual-based method to modify latent representations by posing a ‘what-if’ scenario. |
| Outcome: | The proposed method is tested on multiple attribute transfer tasks like Sentiment, Formality and Excitement to support the hypothesis. |
Enhanced Transformer Model for Data-to-Text Generation (D19-56)
Copied to clipboard
| Challenge: | Neural models have shown significant progress on data-to-text generation tasks . data- to-text models generate descriptive texts from non-linguistic structured data . |
| Approach: | They propose a new data-to-text generation model which learns content selection and summary generation in an end-to end fashion. |
| Outcome: | The proposed model outperforms current state-of-the-art models on content selection precision and content ordering metrics. |
LAVA: Latent Action Spaces via Variational Auto-encoding for Dialogue Policy Optimization (2020.coling-main)
Copied to clipboard
Nurul Lubis, Christian Geishauser, Michael Heck, Hsien-chin Lin, Marco Moresi, Carel van Niekerk, Milica Gasic
| Challenge: | Reinforcement learning (RL) can be used to steer a conversation towards successful task completion. |
| Approach: | They propose to use latent latent variables to shape latent variable distributions . they use response auto-encoding as auxiliary task to capture generative factors . |
| Outcome: | The proposed approach yields a more action-characterized latent representations . the proposed approach achieves state-of-the-art success rates . |
Prompt Refinement with Image Pivot for Text-to-Image Generation (2024.acl-long)
Copied to clipboard
| Challenge: | Recent advances in text-to-image generation have markedly expanded the boundaries of digital artistry, enabling the creation of visually compelling images with unprecedented ease. |
| Approach: | They propose to decompose the prompt refinement process into two tasks: inferring user-preferred images from user languages and translating them into system languages. |
| Outcome: | Experiments show that PRIP outperforms baselines and transfers to unseen systems in a zero-shot manner. |
Combining Sentiment Lexica with a Multi-View Variational Autoencoder (N19-1)
Copied to clipboard
| Challenge: | a new model of sentiment lexica is being developed to combine disparate scales into a common representation. |
| Approach: | They propose a model that unifies disparate scales into a common latent representation . they evaluate a text classification task using nine English-Language sentiment datasets . |
| Outcome: | The proposed model outperforms six individual sentiment lexica and a simple combination thereof. |
Recurrent Inference in Text Editing (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing inference methods map the unedited text to the edited text or to the editing operations, but performance is degraded by the limited source text encoding and long, varying decoding steps. |
| Approach: | They propose a new inference method that iteratively performs editing actions . they introduce three types of editing tasks: AOR, AES, AEC . |
| Outcome: | The proposed method significantly narrows the problem space by iterating editing actions. |
How Positive Are You: Text Style Transfer using Adaptive Style Embedding (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches for unsupervised text style transfer are disentanglement between content and style. |
| Approach: | They propose to separate a model with a sentence reconstruction module and a style module to improve model architecture. |
| Outcome: | The proposed method improves style transfer performance and content preservation . the proposed method can be used to modify a sentence with a specified style attribute . |
Improving Grammatical Error Correction with Data Augmentation by Editing Latent Representation (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for enhancing grammatical error correction use noise to generate tokens . existing methods only generate sentences with limited error types, which leads to lack of diversity of generated errors. |
| Approach: | They propose a data augmentation method that can apply noise to latent representations of a sentence to generate synthetic samples with various error types. |
| Outcome: | The proposed method improves performance and robustness of existing models on public benchmarks and on FCE benchmarks. |
Cycle-Consistent Adversarial Autoencoders for Unsupervised Text Style Transfer (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for unsupervised text style transfer lack parallel data and difficulties in content preservation. |
| Approach: | They propose a neural approach to unsupervised text style transfer using non-parallel data. |
| Outcome: | The proposed approach can be trained end-to-end on two widely-used public datasets. |
Deep Reinforcement Learning-based Text Anonymization against Private-Attribute Inference (D19-1)
Copied to clipboard
| Challenge: | Recent research shows textual data alone may contain enough information about users' private-attributes that they do not want to disclose such as age, gender, location, political views and sexual orientation. |
| Approach: | They propose a novel Reinforcement Learning-based Text Anonymizor which extracts a latent representation of the original text w.r.t. a given task and leverages deep reinforcement learning to learn an optimal strategy for manipulating text representations w/ the received privacy and utility feedback. |
| Outcome: | The proposed approach preserves both privacy and utility of textual data while preserving its utility. |
G-Tuning: Improving Generalization of Pre-trained Language Models with Generative Adversarial Network (2023.findings-acl)
Copied to clipboard
| Challenge: | Empirical evaluations on the GLUE benchmark demonstrate that fine-tuning can enhance the generalization performance of pre-trained language models (PLMs) in downstream tasks. |
| Approach: | They propose a fine-tuning framework that transforms the latent representation of pre-trained language models from a universal space to a target space and integrates a generative adversarial network into the fine-untun process. |
| Outcome: | Empirical evaluations on the GLUE benchmark and two additional demanding scenarios show that the proposed framework can improve the generalization performance of pre-trained language models (PLMs) in downstream tasks. |
Generalizable and Explainable Dialogue Generation via Explicit Action Learning (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Conditioned response generation for task-oriented dialogues implicitly optimizes task completion and language quality. |
| Approach: | They propose to learn natural language actions that represent utterances as a span of words. |
| Outcome: | The proposed approach outperforms latent action baselines on a multi-domain dataset. |
Autoencoding Keyword Correlation Graph for Document Clustering (2020.acl-main)
Copied to clipboard
| Challenge: | Existing representation learning models do not capture the intra-sentential and inter-sententential features of long-text. |
| Approach: | They propose a graph-based representation for document clustering that builds a Graph Autoencoder on a Keyword Correlation Graph. |
| Outcome: | The proposed graph autoencoder can achieve better clustering performance than existing features. |
A Semantic-Aware Layer-Freezing Approach to Computation-Efficient Fine-Tuning of Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing work on how to finetune but neglects the issue of where to fine-tune language models is expensive. |
| Approach: | They propose to use transition traces of latent representation to compute deviations (or loss) and then estimate the gain of each layer in reducing deviation (or gain). |
| Outcome: | The proposed approach outperforms baseline methods and is cost-benefit balanced. |
Learning to Encode Text as Human-Readable Summaries using Generative Adversarial Networks (D18-1)
Copied to clipboard
| Challenge: | a popular approach to learning data representations involves the use of an auto-encoder that compresses data into a latent-space representation without supervision. |
| Approach: | They propose to train an auto-encoder that encodes input text into human-readable sentences . they use comprehensible natural language as a latent representation of the input source text . |
| Outcome: | The proposed auto-encoder can encode input text into human-readable sentences without document-summary pairs. |
Diffusion Lens: Interpreting Text Encoders in Text-to-Image Pipelines (2024.acl-long)
Copied to clipboard
| Challenge: | Text-to-image diffusion models use a latent text prompt to guide image generation . however, the process by which the encoder produces the text representation is unknown . |
| Approach: | They propose a method for analyzing the text encoder of T2I models by generating images from its intermediate representations. |
| Outcome: | The proposed method provides valuable insights into the text encoder component in T2I pipelines. |
Enhancing Unsupervised Generative Dependency Parser with Contextual Information (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to unsupervised dependency parsing are based on probabilistic generative models that learn the joint distribution of the given sentence and its parse. |
| Approach: | They propose a probabilistic model that generates a sentence and its parse from a latent representation, which encodes global contextual information of the generated sentence. |
| Outcome: | The proposed model achieves competitive accuracy compared with state-of-the-art models. |
Large Language Models Can Learn Temporal Reasoning (2024.acl-long)
Copied to clipboard
| Challenge: | Temporal reasoning (TR) is a fundamental ability of large language models (LLMs) however, there is neo-standard methods to perform TR, which are not suitable for large language model applications. |
| Approach: | They propose a framework to enhance temporal reasoning by using a latent representation, temporal graph (TG) instead of reasoning over the original context, they adopt a temporal representation that enhances TR learning. |
| Outcome: | The proposed framework improves the learning of language-based TR by incorporating a latent representation, temporal graph (TG) a synthetic dataset is constructed for fine-tuning LLMs on text-to-TG translation tasks and benchmarks. |
Linguistic Versus Latent Relations for Modeling Coherent Flow in Paragraphs (D19-1)
Copied to clipboard
| Challenge: | a novel approach to paragraph planning involves a high-level control of different levels of relations between sentences . a proposed model with both forms of relations outperforms baselines in partially conditioned paragraph generation task . |
| Approach: | They propose two models that integrate human-created and latent relations into document-level language models . they focus on paragraph-level plan between sentences to produce coherent text . |
| Outcome: | The proposed models outperform baselines in partially conditioned paragraph generation task. |
Decoding a Neural Retriever’s Latent Space for Query Suggestion (2022.emnlp-main)
Copied to clipboard
Leonard Adolphs, Michelle Chen Huebscher, Christian Buck, Sertan Girgin, Olivier Bachem, Massimiliano Ciaramita, Thomas Hofmann
| Challenge: | Neural retrieval models have replaced bag-of-words methods for document retrieval . however, they lack the interpretability of bag-off-word models . |
| Approach: | They train a query decoder that generates a meaningful query from a latent representation of a neural search engine. |
| Outcome: | The proposed model outperforms both query reformulation and PRF information retrieval baselines. |
Style Transformer: Unpaired Text Style Transfer without Disentangled Latent Representation (P19-1)
Copied to clipboard
| Challenge: | Disentangling the content and style in the latent space is prevalent in text style transfer . recurrent neural networks (RNN) based encoder and decoder cannot deal with the long-term dependency . |
| Approach: | They propose a style transformer which disentangles style information in latent space . they propose encoding and decoding methods that disentangle style information . |
| Outcome: | The proposed method can achieve better style transfer and better content preservation. |
Compositional Mathematical Encoding for Math Word Problems (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing MWP encoders work in a unimodal setting and map problem description to latent representation, then for decoding. |
| Approach: | They propose a Compositional Math Word Problem Solver which maps problem description to latent representation and decodes it in an interactive way. |
| Outcome: | Extensive experiments show that the proposed model outperforms state-of-the-art models on public benchmarks. |
An Attentive Fine-Grained Entity Typing Model with Latent Type Representation (D19-1)
Copied to clipboard
| Challenge: | Existing fine-grained entity typing models are criticized for label independence assumption . |
| Approach: | They propose a fine-grained entity typing model with a new attention mechanism and a hybrid type classifier to exploit type inter-dependency with latent type representation. |
| Outcome: | The proposed model significantly advances the state-of-the-art on fine-grained entity typing. |
Evaluation Benchmarks for Spanish Sentence Representations (2022.lrec-1)
Copied to clipboard
Vladimir Araujo, Andrés Carvallo, Souvik Kundu, José Cañete, Marcelo Mendoza, Robert E. Mercer, Felipe Bravo-Marquez, Marie-Francine Moens, Alvaro Soto
| Challenge: | Existing and newly constructed datasets address different tasks from various domains. |
| Approach: | They propose to use Spanish SentEval and Spanish DiscoEval to evaluate stand-alone and discourse-aware sentence representations. |
| Outcome: | The proposed benchmarks evaluate the capabilities of stand-alone and discourse-aware sentence representations in Spanish and show that they are more robust and comparable than previous benchmarks. |
Strong hallucinations from negation and how to fix them (2024.findings-acl)
Copied to clipboard
| Challenge: | Despite great performance on many tasks, language models still struggle with reasoning, sometimes providing responses that cannot possibly be true because they stem from logical incoherence. |
| Approach: | They propose a way to treat negation as an operation over latent representations that constrains how they may evolve. |
| Outcome: | The proposed approach improves model performance in cloze prompting and natural language inference tasks without training on sparse negative data. |
Fooling the Textual Fooler via Randomizing Latent Representations (2024.findings-acl)
Copied to clipboard
| Challenge: | Several adversarial attacks can compromise the model without accessing the model architecture or model parameters (i.e., a blackbox setting) Several studies have revealed that deep NLP models are vulnerable to adversarials that slightly perturb the input to cause the models to misbehave. |
| Approach: | They propose a lightweight and attack-agnostic defense that perplexes the process of generating an adversarial example in query-based black-box attacks. |
| Outcome: | The proposed defense is lightweight and attack-agnostic and does not necessitate additional computational overhead during training nor does it rely on assumptions about the potential adversarial perturbation set while having a negligible impact on the model’s accuracy. |
Generative Error Correction for Emotion-aware Speech-to-text Translation (2025.findings-acl)
Copied to clipboard
| Challenge: | Despite recent advances in speech-to-text translation, the impact of the emotion content has been overlooked. |
| Approach: | They propose to use generative error correction (GER) to generate the translation based on the decoded N-best hypotheses and combine emotion and sentiment labels into the LLM finetuning process to enable the model to consider the emotion content. |
| Outcome: | The proposed model can translate speech in English-Chinese using GER and emotion and sentiment labels. |
Hallucinations as Orthogonal Noise: Inference-Time Manifold Alignment via Dynamic Contextual Orthogonalization (2026.findings-acl)
Copied to clipboard
Mingkuan Zhao, Wentao Hu, Tianchen Huang, Yuheng Min, Suquan Chen, Yide Gao, Yanbo Zhai, Shuangyong Song, Xuelong Li
| Challenge: | Hallucinations in Large Language Models persist in critical domains where generated content diverges from contextual facts or logical constraints. |
| Approach: | They propose to generate hallucinations as orthogonal noise relative to the semantic manifold of the residual stream. |
| Outcome: | The proposed method achieves superior contextual faithfulness compared to state-of-the-art methods. |